Visitor-tailored property configuration

ABSTRACT

Methods, systems, and apparatus, including computer programs encoded on a storage device, are disclosed. A system includes one or more processors and one or more computer storage media storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations including: receiving data indicating that a visitor is scheduled to arrive at a property at a particular time; receiving, at the particular time and from a camera, image data; determining, based on the image data, a characteristic of the visitor; receiving, from a sensor, sensor data that indicates an attribute of the property; and based on the sensor data and on the characteristic of the visitor, selecting and performing a monitoring system action.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the benefit of U.S. Application No. 62/897,467,filed Sep. 9, 2019, which is incorporated by reference in its entirety.

TECHNICAL FIELD

This disclosure application relates generally to monitoring systems withvideo cameras.

BACKGROUND

Many properties are equipped with property monitoring systems thatinclude sensors and connected system components. Some monitoring systemsinclude indoor and outdoor video cameras.

SUMMARY

Many residents and homeowners equip their properties with monitoringsystems to enhance the security, safety, or convenience of theirproperties. A property monitoring system can include video cameras thatcan obtain visual images of scenes at the property. Video cameras can beused to detect and analyze characteristics of people approaching theproperty.

Property monitoring systems can typically be configured for residentsand/or owners of a property. For example, a property owner can configurea property monitoring system by programming a thermostat to a preferredtemperature setting and by programming lighting to a preferredbrightness.

When a property is listed for sale or rent, the property may be visitedby visitors who are interested in purchasing or renting the property.Visitors may schedule a visit, for example, through an internet website,through a mobile application, and/or by contacting the property owner ora realtor representing the property. When the visitor visits theproperty at the scheduled time, it is desirable that the propertyappeals to the individual visitor, so that the visitor is more likely topurchase or rent the property.

Video cameras of a property monitoring system can collect images of avisitor approaching a property. The property monitoring system cananalyze the images to determine characteristics of the visitor. Forexample, the property monitoring system can analyze the images todetermine a visitor's likely age, gender, family status, and othercharacteristics. The property monitoring system can then tailor theproperty to appeal to the visitor by configuring components of theproperty monitoring system.

Video cameras and other sensors of a property monitoring system can alsocollect data while a visitor tours a property. For example, videocameras can analyze images of a visitor to determine if the visitor isresponding positively or negatively to the property as a whole, and/orto specific rooms of the property. Other sensors, such as microphones,can detect a visitor's actions including speech, to determine thevisitor's response to the property.

The monitoring system can generate and update a visitor profile,including the visitor's likely preferences, based on the visitor'sappearance, the visitor's actions while touring the property, or both.The monitoring system can configure components of the propertymonitoring system to appeal to the visitor based on the visitor profile.

The techniques described can be used for properties that are for sale orrent, or in any other application in which it is desirable for aproperty to appeal to a specific visitor or group of visitors. Forexample, a business owner may own a commercial property with a propertymonitoring system. The business owner may host a meeting with animportant client at the commercial property. At the time of the meeting,the property monitoring system can analyze images of the client in orderto tailor the property to appeal to the client.

According to an innovative aspect of the subject matter described inthis application, a monitoring system for monitoring a property includesone or more processors and one or more computer storage media storinginstructions that are operable, when executed by the one or moreprocessors, to cause the one or more processors to perform operations.The operations include receiving data indicating that a visitor isscheduled to arrive at a property at a particular time; receiving, atthe particular time and from a camera, image data; determining, based onthe image data, a characteristic of the visitor; receiving, from asensor, sensor data that indicates an attribute of the property; andbased on the sensor data and on the characteristic of the visitor,selecting and performing a monitoring system action.

Other embodiments of this and other aspects include correspondingsystems, apparatus, and computer programs, configured to perform actionsof methods encoded on computer storage devices. A system of one or morecomputers or other processing devices can be so configured by virtue ofsoftware, firmware, hardware, or a combination of them installed on thesystem that in operation cause the system to perform the operations. Oneor more computer programs can be so configured by virtue havinginstructions that, when executed by data processing apparatus, cause theapparatus to perform the operations.

These and other embodiments may each optionally include one or more ofthe following features, alone or in any combination. In someimplementations, selecting and performing the monitoring system actionincludes classifying, based on the characteristic of the visitor, thevisitor into a category of visitors; identifying property settingspreferred by the category of visitors; determining, based on the sensordata, that a property setting is different from the property settingspreferred by the category of visitors; and adjusting the propertysetting to align the property setting with the property settingspreferred by the category of visitors.

In some implementations, identifying the property settings preferred bythe category of visitors includes accessing a database of propertysettings preferred by multiple categories of visitors.

In some implementations, the operations include: receiving, from asecond sensor at the property, second sensor data indicating a reactionof the visitor to the property; and storing, in the database of propertysettings, the property setting and the data indicating the reaction ofthe visitor to the property.

In some implementations, the operations include: receiving, through auser interface presented to the visitor by a computing device, userinput data indicating a reaction of the visitor to the property; andstoring, in the database of property settings, the property setting andthe user input data indicating the reaction of the visitor to theproperty.

In some implementations, selecting and performing the monitoring systemaction includes: determining, based on the characteristic of thevisitor, a likely preference of the visitor; determining that the sensordata indicates an attribute of the property that is different from thelikely preference of the visitor; and based on determining that thesensor data indicates the attribute of the property that is differentfrom the likely preference of the visitor, adjusting the attribute ofthe property to align the attribute of the property with the likelypreference of the visitor.

In some implementations, determining the likely preference of thevisitor includes: providing the characteristic of the visitor as inputto a machine learning model that has been trained to determine likelypreferences corresponding to visitor characteristics; receiving anoutput from the machine learning model that indicates the likelypreference of the visitor; and determining, based on the received outputfrom the machine learning model, the likely preference of the visitor.

In some implementations, the visitor includes a first visitor. Theoperations include determining, based on the image data, acharacteristic of a second visitor and determining, based on thecharacteristic of the second visitor, a likely preference of the secondvisitor that is different from the likely preference of the firstvisitor. Selecting and performing a monitoring system action includes:classifying the first visitor as a lead visitor; determining that thesensor data indicates an attribute of the property that is differentfrom the likely preference of the first visitor and is different fromthe likely preference of the second visitor; and based on determiningthat the sensor data indicates the attribute of the property that isdifferent from the likely preference of the first visitor and isdifferent from the likely preference of the second visitor, and inresponse to classifying the first visitor as the lead visitor, adjustingthe attribute of the property to align the attribute of the propertywith the likely preference of the first visitor.

In some implementations, the operations include: based on the dataindicating that the visitor is scheduled to arrive at the property atthe particular time, retrieving, at or before the particular time, andfrom a database of visitor profiles, a stored profile for the visitor.

In some implementations, the operations include: determining, based onthe image data and the stored profile, that a person arriving at theproperty at or near the particular time is the visitor.

In some implementations, the stored profile for the visitor includesdata indicating at least one of: a preference of the visitor;demographic information of the visitor; or a reaction of the visitor toa property previously visited by the visitor.

In some implementations, the operations include adding, to the storedprofile for the visitor, the characteristic of the visitor.

In some implementations, the operations include generating a profile ofthe visitor including the characteristic of the visitor and storing theprofile of the visitor in a database of visitor profiles.

In some implementations, the operations include determining, based onthe image data, a characteristic of a group of visitors that includesthe visitor and at least one other visitor; and based on the sensor dataand on the characteristic of the group of visitors, selecting andperforming the monitoring system action.

In some implementations, selecting and performing the monitoring systemaction includes: classifying, based on the characteristic of the groupof visitors, the group into a category of groups; identifying propertysettings preferred by the category of groups; determining, based on thesensor data, that a property setting is different from the propertysettings preferred by the category of groups; and adjusting the propertysetting to align the property setting with the property settingspreferred by the category of groups.

In some implementations, the operations include: receiving, from asecond monitoring system of a second property, data representing aninteraction of the visitor with the second property; determining, basedon the data representing the interactions of the visitor with the secondproperty, a likely preference of the visitor; and based on the likelypreference of the visitor, performing the monitoring system action.

In some implementations, the characteristic of the visitor includes oneor more of an age, gender, apparel, accessory, or mode of transportationof the visitor.

In some implementations, the attribute of the property includes one ormore of a status of an appliance, a lighting level, a sound level, atemperature, or a scent at the property.

The details of one or more implementations of the subject matterdescribed in this specification are set forth in the accompanyingdrawings and the description below. Other features, aspects, andadvantages of the subject matter will become apparent from thedescription, the drawings, and the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example system for visitor-tailoredproperty control and configuration based on video image data.

FIG. 2 is a diagram illustrating an example system for visitor-tailoredproperty control and configuration based on visitor interaction.

FIG. 3 is a flow chart illustrating an example of a process forvisitor-tailored property control and configuration.

FIG. 4 is a diagram illustrating an example of a property monitoringsystem.

Like reference numbers and designations in the various drawings indicatelike elements.

DETAILED DESCRIPTION

FIG. 1 is a diagram illustrating an example system 100 forvisitor-tailored property control and configuration based on video imagedata. A property 102 is monitored by a monitoring system. The property102 can be a home, another residence, a place of business, a publicspace, or another facility that is monitored by a monitoring system. Inthe example in FIG. 1, the property 102 is property that is on themarket for sale or lease. The property 102 may be visited by visitorswho are considering purchasing or renting the property 102.

The property 102 is represented by a realtor 104. The realtor 104 canreceive notifications and alerts regarding the property 102 viacommunication from a monitoring server 150 to a mobile device 106. Themobile device 106 can be, for example, a laptop computer, a tablet, or asmart watch.

The monitoring system at the property 102 includes a local network 120.The network 120 can be any communication infrastructure that supportsthe electronic exchange of data between a control unit 130 and othercomponents of the monitoring system. For example, the network 120 mayinclude a local area network (LAN). The network 120 may be any one orcombination of wireless or wired networks and may include any one ormore of Ethernet, Bluetooth, Bluetooth LE, Z-wave, Zigbee, or Wi-Fitechnologies.

The monitoring system includes one or more sensors 110 located at theproperty 102 that collect sensor data related to the property 102. Themonitoring system has the ability to control various sensors 110 andother devices on the property 102 through automation controls 140.Example sensors 110 can include thermometers, cameras, microphones,smoke detectors, and water flow sensors. The control unit 130 cancollect and assess data from the sensors 110 to monitor the conditionsof the property 102 and detect any anomalies.

The automation controls 140 can include automation controls 140 forvarious devices and appliances at the property 102. For example,automation controls 140 can include controls for televisions 132,thermostats 134, lights 136, window blinds 138, windows 148, coffeemakers 142, air fresheners 144, and/or speakers 146.

An example sensor 110 at the property 102 is an outdoor video camera108. The video camera 108 may be used to monitor for visitorsapproaching the property 102. The video camera 108 can be any kind ofimage capturing device. In some examples, the video camera incorporatesmultiple types of sensors. For example, the video camera 108 can includeone or more of the following: a visual camera, a thermal camera, and amotion sensor. In some examples, the video camera 108 continuouslycollects images. In some examples, the video camera 108 collects imageswhen triggered by a sensor, e.g., a motion sensor.

In some examples, video cameras may be positioned in common areas thatmay be near the property 102. For example, the property 102 may be anapartment at an apartment complex. One or more video cameras may bepositioned in a location such as a leasing office of the apartmentcomplex. The monitoring system may include the video cameras in theleasing office in addition to, or instead of, the video camera 108located at the property 102.

The video camera 108 may include an embedded computer with videoanalytics software. The video analytics software can use imagesegmentation or other computer vision technology to perform videoanalysis on images captured by the video camera 108. In someimplementations, the video camera 108 may transmit images to the controlunit 130, and the control unit 130 may perform video analysis on theimages. In some implementations, the control unit 130 transmits imagesto the monitoring server 150, and the monitoring server 150 performsvideo analysis on the images. The video camera 108, the control unit130, and/or the monitoring server 150 may perform video analysis on theimages to detect and identify objects and/or perform facial recognitionwithin the field of view of the video camera 108. For example, the videocamera 108, control unit 130, and/or monitoring server 150 may detectand identify people, animals, and/or vehicles at the property 102.

The control unit 130 can be, for example, a computer system or otherelectronic device configured to communicate with the sensors 110. Thecontrol unit 130 can also perform various management tasks and functionsfor the monitoring system. In some implementations, the realtor 104, aresident, or another user can communicate with the control unit 130(e.g., input data, view settings, or adjust parameters) through aphysical connection, such as a touch screen or keypad, through a voiceinterface, or over a network connection.

The monitoring server 150 can be, for example, one or more computersystems, server systems, or other computing devices that are locatedremotely from the property 102 and that are configured to processinformation related to the monitoring system at the property 102. Insome implementations, the monitoring server 150 is a cloud computingplatform.

The control unit 130 communicates with the monitoring server 150 via along-range data link. The long-range data link can include anycombination of wired and wireless data networks. For example, thecontrol unit 130 can exchange information with the monitoring server 150through a wide-area-network (WAN), a broadband internet connection, acellular telephony network, a wireless data network, a cable connection,a digital subscriber line (DSL), a satellite connection, or otherelectronic means for data transmission. In some implementations, thelong-range data link between the control unit 130 and the monitoringserver 150 is a secure data link (e.g., a virtual private network) suchthat the data exchanged between the control unit 130 and the monitoringserver 150 is encoded to protect against interception by an adversethird party.

In stage (A) of FIG. 1, the monitoring system acquires schedule data111. The schedule data 111 includes an estimated time that a visitor orgroup of visitors is expected to arrive. The schedule data 111 includesan estimated time of arrival of 10:00 am.

In some examples, the schedule data 111 can include specific propertiesout of multiple properties that the visitor is scheduled to visit. Forexample, an apartment complex may include multiple apartments availablefor rent. The schedule data 111 can include the one or more of themultiple apartments that the visitor is scheduled to visit.

The schedule data 111 can include information provided by, for example,a realtor or leasing agent. For example, a leasing agent may provideinformation indicating specific properties out of multiple propertiesthat the visitor requests to visit. The leasing agent may input theinformation to the monitoring system through, e.g., a mobile applicationor internet website.

The schedule data 111 can include information provided by a visitor inadvance of the visit, e.g., information provided when scheduling thevisit through an internet website or mobile application. A visitor mayprovide information that can include, for example, the number ofvisitors, photographs of visitors, visitors' names, ages, genders,and/or family status.

The schedule data 111 indicates that the visitor who scheduled the visitis an adult female. The adult female provided information that she isvisiting with a group of three visitors, including a husband and son.Based on the adult female scheduling the visit on behalf of the group,the monitoring system may identify the adult female to be the primaryvisitor of the group. The monitoring system can identify the primaryvisitor as the leader of the group and/or the visitor within the groupwho is most likely to make decisions regarding purchasing and/or rentingthe property 102.

In stage (B) of FIG. 1, the monitoring system acquires observation data112. At or near the scheduled time of arrival, the video camera 108collects images of a group 125 of visitors. The group 125 includes threevisitors 122, 124, 126. The video camera 108 performs video analysis ofthe images using embedded video analytics software. The video camera 108sends the observation data 112 to the control unit 130 over the network.The observation data 112 includes the results of the video analysis ofthe images.

The observation data 112 can include information related to the group'smethod of transportation to the property 102. The video camera 108determines that the group 125 arrived at the property 102 in a sportsutility vehicle and that the sports utility vehicle has an attachedbicycle rack.

The observation data 112 can include information related to theappearance of each visitor of the group 125. For example, theobservation data 112 includes information regarding the appearance ofthe visitor 122, based on video analysis. The observation data 112 forthe visitor 122 indicates that the visitor 122 is an adult femalebetween the ages of 35 and 40. The video camera 108 determines that thevisitor 122 is wearing a tank top and sunglasses and that the visitor122 is carrying a coffee mug.

The observation data 112 for the visitor 124 indicates that the visitor124 is an adult male between the ages of 35 and 40. The video camera 108determines that the visitor 124 is wearing a t-shirt with a logo for acountry music band.

The observation data 112 for the visitor 126 indicates that the visitor126 is a male child between the ages of seven and ten. The video camera108 determines that the visitor 126 is wearing a t-shirt and shorts.

The control unit 130 receives the observation data 112. The control unit130 may analyze, sort, and/or filter the data. In some examples, thevideo camera 108 can send video images to the control unit 130 and thecontrol unit 130 can perform video analysis on the video images. Thecontrol unit 130 receives additional sensor data from other sensors 110of the property 102. For example, the control unit 130 can receive datarelated to the configurations of various appliances and components ofthe monitoring system at the property 102.

In stage (C) of FIG. 1, the control unit 130 sends monitoring systemdata 114 to the monitoring server 150. The monitoring system data 114can include the observation data 112 indicating the arrival of the group125 and the appearance of the group 125, based on video analysis.

The monitoring system data 114 can include additional sensor data fromthe sensors 110. The monitoring system data 114 includes the indoor andoutdoor temperature at the property 102 as measured by thermometers. Theindoor temperature is 75 degrees, while the outdoor temperature is 60degrees. The monitoring system data 114 includes current weather data atthe property 102, including data indicating that the sky is overcast.

The monitoring system data 114 can include the status and/orconfigurations of various components of the monitoring system. Forexample, the monitoring system data 114 can include data from a windowsensor indicating that the window 148 is shut, and data from a windowblind controller indicating that the window blinds 138 are open. Themonitoring system data 114 can include data from a light sensorindicating that the lights 136 are set to full brightness. Themonitoring system data 114 can also include the on/off status of variousappliances. For example, the monitoring system data 114 can include dataindicating that the television 132, speaker 146, and coffee maker 142are off.

In stage (D) of FIG. 1, the monitoring server 150 analyzes themonitoring system data 114 to determine visitor characteristics 115. Themonitoring system data 114 can correlate the observation data 112 withthe schedule data 111, including any information previously provided bythe primary, or lead, visitor. For example, the schedule data 111includes that the primary visitor is an adult female. The observationdata 112 includes information regarding the appearance of the visitor122, based on video analysis. The observation data 112 for the visitor122 indicates that the visitor 122 is an adult female. Therefore, themonitoring server 150 can determine that the visitor 122 is the primaryvisitor. Similarly, based on correlating the observation data 112 withthe schedule data 111, the monitoring server 150 can determine that thevisitor 124 is likely the primary visitor's husband, and the visitor 126is likely the primary visitor's son.

Visitor characteristics 115 can include likely preferences of thevisitors, based on the monitoring system data 114. For example, visitorcharacteristics 115 can include visitors' likely preferences related totemperature, lighting, scent, and sound.

The monitoring server 150 can analyze the monitoring system data 114 todetermine visitor characteristics 115 of the group 125 as a whole. Forexample, each visitor within the group 125 is lightly dressed. Thevisitors 124 and 126 are wearing t-shirts, while the visitor 122 iswearing a tank top. The monitoring system data 114 indicates that theoutdoor temperature is 60 degrees. Thus, the monitoring server 150 maydetermine that the group 125 likely prefers cooler temperatures.Additionally, the group 125 arrives at the property 102 in a sportsutility vehicle with a bicycle rack. The monitoring server 150 cananalyze the data related to the group's transportation and determinethat the group 125 likely enjoys spending time outdoors.

The monitoring server 150 can analyze the monitoring system data 114 todetermine visitor characteristics 115 of the individual visitors 122,124, 126 within the group 125. For example, the observation data 112indicates that the visitor 122 is wearing sunglasses. The monitoringsystem data 114 indicates that the sky is overcast. The monitoringserver 150 can determine that the visitor 122 likely prefers dimlighting. The visitor 122 is also carrying a coffee mug. The monitoringserver 150 can determine that the visitor 122 likely enjoys the tasteand scent of coffee. Similarly, the visitor 124 is wearing a countrymusic band t-shirt. The monitoring server 150 can determine that thevisitor 124 enjoys the sounds of country music.

In some examples, the monitoring server 150 can determine visitorcharacteristics 115 based on pre-programmed characteristic rules 151.For example, a characteristic rule 151 may state that a visitor wearinga coat when the outdoor temperature is above 65 degrees prefers warmtemperatures. In another example, characteristic rules 151 may statethat female visitors prefer floral scents, while male visitors preferfruity scents.

In some examples, the monitoring server 150 can determine visitorcharacteristics 115 using a characteristic machine learning algorithm153. For example, the monitoring server 150 can collect data fromvisitors of multiple properties over time. The monitoring server 150 canmonitor visitors' reactions to various temperatures, sounds, lighting,and scents. In some examples, the monitoring server 150 can monitorvisitors' reactions by collecting image and/or audio data from theproperties. The monitoring server 150 can analyze images of a visitorand/or audio data from a visitor's speech to determine if the visitorhas a positive reaction or a negative reaction to the property. Themonitoring server 150 can update the characteristic machine learningalgorithm 153 based on analyzing visitor responses to the varioustemperatures, sounds, lighting, and scents.

In stage (E) of FIG. 1, the monitoring server 150 selects and performssystem actions 116. System actions 116 can include, for example, sendinga command to the control unit 130 to configure a device at the property102 through automation controls 140. System actions 116 can also includesending a notification, e.g., to the mobile device 106 of the realtor104.

In some examples, the monitoring server 150 selects and performs systemactions 116 in specific properties, out of multiple properties, that thegroup 125 is scheduled to visit. For example, based on observation data112 from a video camera in a leasing office of an apartment complex, andschedule data 111 including the specific apartments that the visitor isscheduled to visit, the monitoring server 150 may select and performsystem actions 116 in only those specific apartments.

In some examples, the monitoring server 150 can select system actions116 based on pre-programmed system action rules 152. The system actionrules 152 may be set by, for example, an installer or operator of theproperty monitoring system. For example, a system action rule 152 maystate that the monitoring server 150 sends a notification to the realtor104 when visitors first arrive at the property 102. In some examples, asystem action rule 152 may state that if a group of visitors includes achild under the age of twelve, the monitoring server 150 sends a commandto the control unit 130 to turn on the television 132 to a televisionprogram appropriate for children.

In some examples, the monitoring server 150 can select system actions116 using a system action machine learning algorithm 154. For example,the monitoring server 150 can collect data from visitors of multipleproperties over time. The monitoring server 150 can configure devices atthe properties, and can monitor visitors' reactions to the variousdevice configurations. In some examples, the monitoring server 150 canmonitor visitors' reactions by collecting image and/or audio data fromthe properties. The monitoring server 150 can analyze images of avisitors and/or audio data from a visitor's speech to determine if thevisitor has a positive reaction or a negative reaction to the property.

In some examples, the monitoring server 150 can monitor visitors'reactions to a property by receiving feedback directly from thevisitors, e.g., through a post-visit survey. The monitoring server 150can update and improve the system action machine learning algorithm 154over time, based on reactions from multiple visitors at multipleproperties.

In some examples, the monitoring server 150 can evaluate visitors'reactions to a property based on property sale data. For example, themonitoring server 150 can receive public data related to the speed ofsale and the price of sale of various properties that were tailoredbased on visitor preferences. The monitoring server 150 can update andimprove the system action machine learning algorithm 154 over time,based on analyzing the property sale data.

In some examples, the monitoring server 150 can determine system actions116 based on prioritizing the likely preferences of the primary visitorover the likely preferences of other visitors. For example, the visitor122 is wearing sunglasses on an overcast day. The monitoring server 150determines that the visitor 122 likely prefers dim lighting. Thevisitors 124, 126 are not wearing sunglasses. The monitoring server 150determines that the visitors 124, 126 likely do not prefer dim lighting.The monitoring server 150 may prioritize the preferences of the visitor122, because the visitor 122 is the primary visitor. Thus, if there is aconflict between the preferences of visitors within the group 125, themonitoring server 150 can determine system actions 116 based on thelikely preferences of the visitor 122.

The monitoring server 150 performs the system actions 116 based on theanalysis of the monitoring system data 114 and the visitorcharacteristics 115. For example, based on the arrival of the group 125,the monitoring server 150 sends a notification to the realtor 104. Themonitoring server 150 can send the notification to the realtor 104 via,for example, an email that the realtor 104 can receive on the mobiledevice 106. The monitoring server 150 can also send the notification tothe realtor 104 via, for example, a text message or telephone call.

The monitoring system data 114 includes data indicating that the indoortemperature is 75 degrees. Based on the visitor characteristic 115 thatthe group 125 likely prefers cooler temperatures, the monitoring server150 sends a command to the control unit 130 to reduce the thermostat 134temperature to 70 degrees. Based on the visitor characteristic 115 thatthe group 125 likely enjoys spending time outdoors, the monitoringserver 150 sends a command to the control unit 130 to activate the airfreshener 144 to release an outdoor scent using automation controls 140.Based on the visitor characteristics 115 that the group 125 both preferscooler temperatures and enjoys spending time outdoors, the monitoringserver 150 sends a command to open the windows 148.

The monitoring server 150 performs certain system actions 116 based onthe likely preferences of individual visitors within the group 125. Forexample, based on the visitor characteristic 115 that the visitor 122likely prefers dim lighting, the monitoring server 150 sends a commandto lower the window blinds 138 and dim the lights 136. Based on thevisitor characteristic 115 that the visitor 122 likely enjoys coffee,the monitoring server 150 sends a command to turn on the coffee maker142. Based on the observation data 112 that the visitor 126 is a childbetween the ages of 7 and 10, the monitoring server 150 sends a commandto turn on the television 132 to an age-appropriate program. Based onthe visitor characteristic 115 that the visitor 124 likely enjoyscountry music, the monitoring server 150 sends a command to play countrymusic on the speaker 146. In some examples, the monitoring server 150can select to play certain country music songs based on the age of thevisitor 124, determined from the observation data 112. For example, themonitoring server 150 may select to play country music songs that werepopular approximately during the time when the visitor 124 was a youngadult.

In some examples, system actions 116 can include displaying informationrelated to the property 102 and/or the neighborhood for the group 125 toview. For example, the property may include a display screen or a devicethat can display an electronic pamphlet. The monitoring system canconfigure the pamphlet to display information based on the likelypreferences of the group 125. For example, the group 125 is a familywith a young child. Therefore, the monitoring system may select toconfigure the pamphlet to display information related to family friendlyamenities, e.g., nearby schools and parks. If a visitor or group ofvisitors are young adults, the monitoring system may select to configurethe pamphlet to display information related to, for example, localrestaurants and nightlife.

In some examples, system actions 116 can include adjusting configurablefurniture. Configurable furniture may be, for example, motorized and/orrobotic furniture that can be adjusted by the monitoring system. Anexample of configurable furniture may be a set of shelves that can beadjusted to expand into a closet. In another example, configurablefurniture can include a sofa that can be adjusted to expand into a bed.The monitoring system can adjust the configurable furniture based on thelikely preferences of the group 125. For example, observation data 112may indicate that the visitor 122 is wearing fashionable clothing. Themonitoring server 150 can determine that closet space is likelyimportant to the visitor 122. Therefore, the monitoring system mayselect to adjust a configurable set of shelves to expand into a closet.In another example, the monitoring system can adjust configurablefurniture to protect fragile items and/or decorations. For example,based on the group 125 including the child visitor 126, the monitoringsystem can raise configurable shelves containing fragile items to aheight that the visitor 126 cannot reach.

In some examples, the monitoring system can coordinate system actions116 based on a theme or mood. For example, the monitoring system maydetermine that a primary visitor of a group of visitors enjoys calmactivities and calm music. The monitoring system can coordinate systemactions 116 to tailor the entire property to the primary visitor basedon a calm theme or mood. For example, the monitoring system can playmeditation music through a speaker, dim the lighting, and turn off thetelevision. The monitoring system may select to configure the entireproperty based a calm theme, even if analysis of additional visitorsindicates that their preferences conflict with those of the primaryvisitor.

In some examples, the monitoring server 150 can perform the systemactions 116 before the group 125 enters the property 102. For example,the monitoring server 150 can perform the system actions 116 while thegroup 125 walks up to the front door of the property 102. When the group125 enters the property 102, the property monitoring system may alreadybe tailored for the group 125.

Though described above as being performed by a particular component ofsystem 100 (e.g., the control unit 130 or the monitoring server 150),any of the various control, processing, and analysis operations can beperformed by either the control unit 130, the monitoring server 150, oranother computer system of the system 100. For example, the control unit130, the monitoring server 150, or another computer system can analyzethe data from the sensors 110 to determine the system actions 116.Similarly, the control unit 130, the monitoring server 150, or anothercomputer system can control the various sensors 110, and/or the propertyautomation controls 140, to collect data or control device operation.

FIG. 2 is a diagram illustrating an example system 200 forvisitor-tailored property control and configuration based on visitorinteraction. The system 200 includes a property 202 that is monitored bymonitoring system and is available for sale or rent. The monitoringsystem for the property 202 can collect data related to visitor actionsat the property 202. For example, the monitoring system can collectinformation related to visitor interaction with devices and appliancesat the property 202 as the visitor tours the property 202. The property202 is represented by a realtor 204. The realtor 204 can receivenotifications and information related to the property 202 from amonitoring server 250, including information related to visitor actionsat the property 202.

The property monitoring system includes sensors. Example sensors caninclude video cameras. Video cameras can be located indoors andoutdoors. For example, video camera 210 is located outdoors, near afront door 212. Video camera 214 is located in a living room, videocamera 216 is located in a kitchen, video camera 218 is located in abasement, and video camera 220 is located in a den. Additional sensorscan include water flow sensors. For example, water flow sensors may beinstalled to detect a flow of water to and from plumbing fixtures, e.g.,sinks, toilets, and bathtubs. Sensors can also include appliancemonitors that can determine if appliances are turned on or off. Examplesensors can also include door and window sensors that can determine ifwindows and/or doors of the property 202 are open or shut.

Similar to the monitoring system of the property 102, the sensors of theproperty 202 communicate with a control unit 230 over a local network.The control unit 230 communicates with a monitoring server 250 over along-range data link.

The monitoring server 250 may include a visitor profile 252 for visitorsto the property 202. In some examples, the monitoring server 250includes a visitor profile 252 for each individual visitor to theproperty 202. In some examples, the monitoring server 250 may include agroup profile for each group of visitors to the property 202, where agroup of visitors is a collection of multiple visitors who visit theproperty 202 together at the same time. In some examples, the monitoringserver 250 may include both a group profile for each group of visitors,and an individual profile for each individual visitor.

In some examples, the monitoring server 250 creates a visitor profile252 when a visitor schedules a visit to the property 202. The visitorprofile 252 can include any information provided by the visitor whenscheduling the visit. For example, the visitor profile 252 can includethe visitor's name, age, and gender. In some examples, the monitoringserver 250 creates a visitor profile 252 when the visitor arrives at theproperty 202. The monitoring server 250 may add data to the visitorprofile 252 as the visitor tours and interacts with the property 202. Insome examples, the visitor profile 252 can include data collected fromprevious visits to the property 202 or to another property. For example,a certain visitor may visit a property more than one time, and/or mayvisit multiple properties. Each time the visitor visits a property witha monitoring system that communicates with the monitoring server 250,the monitoring server 250 can update the visitor profile with datacollected during the visit.

The visitor profile 252 can include data including visitor actions atthe property 102. The visitor profile 252 can include visitorpreferences based on analysis by the monitoring server 250. For example,the visitor profile 252 can include a visitor's preferences fortemperature, lighting, scent, and sound. The monitoring server 250 canupdate the visitor profile 252 when new data is collected.

The monitoring server 250 may include a property profile 254 for theproperty 202. The property profile 254 may include data collected fromone or more visitors to the property 202. For example, at a certainproperty, many visitors may depart from the property immediately aftertouring the basement. The monitoring server 250 can update the propertyprofile 254 each time a visitor departs the property. The monitoringserver 250 can analyze the data of the property profile 254 anddetermine that there is a trend of visitors departing the property aftertouring the basement. Based on this determination, the monitoring server250 can take a system action, e.g., by notifying a realtor representingthe property that there may be a problem with the basement.

In stage (A) of FIG. 2, a visitor 222 approaches the property 202. Thevisitor may have scheduled a visit in advance, e.g., through an internetwebsite or mobile application. If the visitor scheduled the visit inadvance, the monitoring server 250 may already have a visitor profile252 for the visitor 222. If the visitor did not schedule the visit inadvance, the monitoring server 250 may create a visitor profile 252 forthe visitor 222 upon arrival.

The video camera 210 collects images of the visitor 222 outside of theproperty 202. The monitoring server 250 analyzes the images of thevisitor 222. In some examples, the monitoring server 250 correlates theimages of the visitor 222 with an existing visitor profile 252. Forexample, the visitor 222 may have a visitor profile 252 indicating thathe is a 25 year old male. When the visitor 222 arrives at the property202, the monitoring server 250 confirms through video analysis that thevisitor 222 is an adult male in his twenties. The monitoring server 250can then add data collected from the sensors at the property 202 to thevisitor profile 252 of the visitor 222. For example, if the visitor 222arrives at the property with a young child, the monitoring server 250may determine that the visitor 222 is likely a parent of the child. Themonitoring server 250 can add the determination that the visitor 222 islikely the parent of the child to the visitor profile 252.

As described in reference to FIG. 1, the monitoring system can analyzethe image data from the video camera 214 and take system actions basedon the observation data of the visitor 222, before the visitor 222enters the property 202. For example, the monitoring system may dim orbrighten lights, activate air fresheners, and/or play music based on theobservation data of the visitor 222. The monitoring system may turn onthe television 232 to a television program that the visitor 222 islikely to enjoy. The monitoring system may also adjust configurablefurniture based on the likely preferences of the visitor 222. Forexample, based on the visitor 222 being an adult male in his twenties,the monitoring server 150 may determine that the visitor 222 likelyprefers open spaces for hosting parties and gatherings. The monitoringsystem may then adjust configurable furniture to reduce the amount offurniture-occupied floor space at the property 202. For example, themonitoring system may adjust an expandable bed to contract into a sofa245.

In stage (B) of FIG. 2, the visitor 222 enters the living room. Theliving room includes the video camera 214. The video camera 214 cancollect images of the actions of the visitor 222 in the living room. Theliving room has a lamp 224 that is initially off. The visitor 222 turnsthe lamp 224 on. The video camera 214 collects images of the visitorturning the lamp 224 on. Additionally, an appliance monitor connected tothe lamp 224 detects that the lamp 224 turns on. The video camera 214and the appliance monitor send data to the control unit 230 indicatingthat the visitor 222 turned the lamp 224 on. Based on the visitor 222turning the lamp 224 on, the control unit 230 may determine that theproperty 202 is too dark for the visitor's preferences. The control unit230 can send a command to turn on other lamps at the property, e.g., thelamp 226, located in the den.

The control unit 230 sends data to the monitoring server 250 indicatingthat the visitor 222 turned on the lamp 224. The monitoring server 250can add the data to the visitor profile 252 and to the property profile254. Based on the data indicating that the visitor 222 turned on thelamp 224, the monitoring server 250 may determine that the visitor 222likely prefers bright lighting. If other visitors also turn on the lamp224 after entering the property 202, the monitoring server 250 maydetermine that the living room is too dimly lit for visitors'preferences.

In stage (C) of FIG. 2, the visitor 222 enters the dining room. Thedining room includes a smart speaker 236. The smart speaker 236 candetect speech of the visitor 222 and perform actions in response to thespeech. The smart speaker 236 detects the visitor 222 saying “It's hotin here!” In some examples, the smart speaker 236 may interpret thespeech and respond by performing an action, e.g., by sending a commandthrough the network to the thermostat 234 to reduce the temperature ofthe property 202. In some examples, the smart speaker 236 may send datarepresenting the visitor's speech to the control unit 130. The controlunit 130 and/or the monitoring server 250 can interpret the visitor'sspeech and determine to send a command to lower the thermostat 234 inresponse. The monitoring server 250 can also store the data in thevisitor profile 252, indicating that the visitor 222 likely preferscooler temperatures, and in the property profile 254, indicating thatthe thermostat 234 at the property 202 may be set too high.

In stage (D) of FIG. 2, the visitor 222 enters the kitchen. The kitchenincludes the video camera 216. The video camera 216 detects the visitor222 opening and shutting a door of a refrigerator 242, opening andshutting a window 240, and running a faucet of a sink 244. An appliancemonitor may also detect the door of the refrigerator 242 opening andshutting. A window sensor may detect the window 240 opening andshutting, and a water flow sensor may detect the sink 244 running. Thevideo camera 216, appliance monitor, window sensor, and water flowsensor can send data related to the visitor's actions in the kitchen tothe monitoring server 250 via the control unit 230. The monitoringserver 250 can add the data to the visitor profile 252. The datacollected from the kitchen sensors may indicate that the visitor 222 isconcerned with the functionality of appliances and fixtures of theproperty 202. The data collected from the kitchen may also indicate thelevel of seriousness of the visitor 222 in considering purchasing theproperty 202. For example, a visitor who is not seriously consideringpurchasing a property might walk through quickly. The visitor 222 isoperating and inspecting appliances and fixtures of the property 202,which may indicate that the visitor 222 can be considered a seriousprospective buyer.

In stage (E) of FIG. 2, the visitor 222 enters the basement. Thebasement includes the video camera 218. The video camera 218 detects thevisitor 222 inspecting laundry machines 246 and a water heater 248. Thevideo camera 218 collects an image 258 of the visitor's face. The videocamera 218 performs facial expression recognition on the image 258 todetermine the visitor's facial expressions using video analyticssoftware. The video camera 218 determines that the visitor 222 isfrowning. The video camera 218 can send the image 258 and/or dataindicating that the visitor 222 is frowning to the monitoring server 250via the control unit 230. In response to receiving data indicating thatthe visitor 222 is frowning in the basement, the monitoring server 250may perform a system action. For example, the monitoring server 250 maysend a notification to the mobile device 206 of the realtor 204. Thenotification may state that the visitor 222 appears to be unhappy withthe basement. The notification may prompt the realtor 204 to call thevisitor 222 to ask how the visitor's experience is going. The realtor204 may then be able to remedy any problems that the visitor 222 ishaving.

In stage (F) of FIG. 2, the visitor 222 enters the bathroom. A doorsensor may detect the door 256 opening when the visitor 222 enters, andclosing when the visitor 222 departs, the bathroom. Water flow sensorsmay detect water flowing from a plumbing fixture in the bathroom, suchas a bathtub 255. The door sensor can send data to the monitoring server250 indicating that the visitor 222 spent eight minutes inspecting thebathroom. A longer duration of time may indicate that the visitor 222performed a thorough inspection of the bathroom. Water flow sensor dataindicating that the visitor 222 operated all of the fixtures in thebathroom can confirm that the visitor 222 performed a thoroughinspection, which can indicate that bathrooms are a priority for thevisitor 222. The monitoring server 250 can add the data related to thevisitor's interaction with bathroom fixtures, and time spent inspectingthe bathroom, to the visitor profile 252.

In stage (G) of FIG. 2, the visitor 222 enters the den. The den includesthe video camera 220. The den also includes a door 262 to a backyard.When the visitor 222 enters the den, the television 232 is displaying atelevision program and the lamp 226 is on. The video camera 220 cancollect images of the visitor 222 in the den. The video camera 220collects an image 260 of the visitor's face. The video camera 220performs facial expression recognition on the image 260 and determinesthat the visitor 222 is smiling. The video camera 220 can send the image260 and/or data indicating that the visitor 222 is smiling to themonitoring server 250 via the control unit 130. In response to receivingdata indicating that the visitor 222 is smiling in the den, themonitoring server 250 can store the data in the visitor profile 252. Thedata may indicate that the visitor 222 is happy with the lighting leveland/or the television program in the den. The data may also indicatethat the visitor 222 is happy with the backyard of the property 202 asseen through the door 262.

As the visitor 222 progresses through the property, the monitoringserver can update the visitor profile 252, the property profile 254, orboth, with information related to the amount of time spent in each room,and the amount of total time spent at the property 202. The amount oftime spent in each room can be based on, for example, image data fromthe video cameras throughout the property. The amount of time spent ineach room can also be based on the timing of doors opening and closingbetween rooms.

As the visitor 222 progresses through the property 202, the monitoringserver 250 can use the collected data to update a machine learningalgorithm. The machine learning algorithm may include likely visitorpreferences based on the visitor's age and gender. For example, themachine learning algorithm may indicate that adult males in theirtwenties enjoy modern pop music. The monitoring server 250 may select toplay modern pop music through the speaker 236 when the visitor 222enters the property 202. The visitor may react to the music, e.g., bysaying “I don't like this song,” by frowning, and/or by turning thespeaker 236 volume down or off. Sensors can send data indicating thevisitor's reaction to the music to the monitoring server 250. Themonitoring server 250 can update the machine learning algorithm based onthe visitor's negative reaction to the music. Over time, the monitoringserver 250 can improve the accuracy of the algorithm by collecting andanalyzing data from multiple visitors at multiple properties.

Though described above as being performed by a particular component ofsystem 200 (e.g., the control unit 230 or the monitoring server 250),any of the various control, processing, and analysis operations can beperformed by either the control unit 230, the monitoring server 250, oranother computer system of the system 200. For example, the control unit230, the monitoring server 250, or another computer system can analyzethe data from sensors. Similarly, the control unit 230, the monitoringserver 250, or another computer system can control the various sensors,and/or the property automation controls, to collect data or controldevice operation.

FIG. 3 is a flow chart illustrating an example of a process 300 forvisitor-tailored property control and configuration. Process 300 can beperformed by one or more computer systems, for example, the monitoringserver 150, the control unit 130, or the camera 108 of the system 100.In some implementations, some or all of the process can be performed byanother computer system located at the monitored property. In someexamples, the control unit 130 may perform some steps of the process300, while the monitoring server 150 performs other steps of the process300. In some examples, the control unit 130 or the monitoring server 150may perform all of the steps of the process 300

Briefly, process 300 includes receiving data indicating that a visitoris scheduled to arrive at a property at a particular time (310), at theparticular time, receiving, from a camera, image data (320), based onthe image data, determining a characteristic of the visitor (330),receiving, from a sensor, sensor data that indicates an attribute of theproperty (340), and, based on the sensor data and on the characteristicof the visitor, selecting and performing a monitoring system action(350).

In more detail, the process 300 includes receiving data indicating thata visitor is scheduled to arrive at a property at a particular time(310). The visitor can be, for example, the visitor 122 of the system100. The visitor may schedule a time to arrive at the property, e.g.,the property 102, through an internet website or a mobile application. Amonitoring server can receive information that the visitor provides whenscheduling the visit. For example, the visitor may provide informationincluding the visitor's name, age, gender, and/or a photograph of thevisitor. The visitor may also provide information on additional visitorsof a group of visitors, e.g., the visitors 124, 126 of the group 125.The information can include the size of the group of visitors, therelationships between the visitors, and each visitor's name, age,gender, and/or a photograph.

The process 300 includes, at the particular time, receiving, from acamera, image data (320). The camera can be, for example, the videocamera 108. When the visitor arrives, the camera obtains images of thevisitor. The camera sends the image data to the monitoring server. Theimage data can include the results of video analysis performed on theimages. For example, the image data can include data indicating that thevisitor 122 appears to be an adult female wearing a tank top andsunglasses, and carrying a coffee mug.

In some examples, based on the data indicating that the visitor isscheduled to arrive at the property at the particular time, the systemcan retrieve, at or before the particular time, and from a database ofvisitor profiles, a stored profile for the visitor. For example, thecontrol unit 230 may receive data indicating that the visitor 222 isscheduled to arrive at noon. At or before noon, the control unit 230 canretrieve the visitor profile 252 from a database of profiles stored bythe control unit 230 or the monitoring server 250.

The stored profile for the visitor can include data indicating at leastone of a preference of the visitor, demographic information of thevisitor, or a reaction of the visitor to a property previously visitedby the visitor. For example, the visitor profile 252 indicates apreference of the visitor 222 for cool temperatures. The visitor profile252 also includes demographic information indicating that the visitor222 is a twenty-five year old male. The visitor profile 252 alsoincludes data indicating that the visitor's priority is bathrooms, basedon a reaction of the visitor 222 to a property previously visited by thevisitor 222.

The system may determine, based on the image data and the storedprofile, that a person arriving at the property at or near theparticular time is the visitor. For example, at or near noon, the camera210 may capture images of an adult male arriving the property 202. Thecamera 210 can generate image data indicating that the camera iscapturing images of an adult male. The control unit 230 can receive theimage data from the camera 210. Based on the image data indicating theadult male, and the stored visitor profile 252 indicating that thevisitor 222 is a twenty-five year old male, the control unit 230 candetermine that the person arriving at the property 202 at or near noonis the visitor 222.

The process 300 includes, based on the image data, determining acharacteristic of the visitor (330). The characteristic of the visitormay include one or more of an age, gender, apparel, accessory, or modeof transportation of the visitor. The monitoring server can analyze theimage data to determine a characteristic of the visitor that mayindicate the visitor's likely preferences for temperature, lighting,scent, and/or sound. In some examples, the camera 210 or the controlunit 230 may analyze the image data to determine the characteristic ofthe visitor. For example, the camera 210, the control unit 230, or themonitoring server 250 may analyze the image data to determine acharacteristic of the visitor 222 that the visitor is greater than sixfeet tall.

In some examples, the system can add, to a stored profile for thevisitor, the characteristic of the visitor. For example, the system canadd, to a stored profile for the visitor 222, the characteristic thatthe visitor 222 is greater than six feet tall. The profile may bestored, for example, by the control unit 130 or the monitoring server250.

In some examples, the process can include generating a profile of thevisitor including the characteristic of the visitor, and storing theprofile of the visitor in a database of visitor profiles. For example,the system may generate a profile of the visitor 222, including thecharacteristic that the visitor 222 is greater than six feet tall. Thesystem can store the profile of the visitor in a database stored, e.g.,by the control unit 230 or the monitoring server 250.

In some examples, the process can include determining, based on theimage data, a characteristic of a group of visitors that includes thevisitor and at least one other visitor. For example, the system mayanalyze image data from images of the group 125, including the visitor122 and additional visitors 124, 126. Based on analyzing the image data,the system may determine a characteristic of the group 125 that thegroup 125 is a family of three that includes a school-age child.

The process 300 includes receiving, from a sensor, sensor data thatindicates an attribute of the property (340). The sensor can include,for example, a thermometer, a microphone, a camera, a motion sensor,etc. The attribute of the property can include one or more of a statusof an appliance, a lighting level, a sound level, a temperature, or ascent at the property. The monitoring server can receive data from asensor indicating, for example, the temperature and lighting levels ofthe property. The monitoring server can receive data from a sensorindicating the status of certain devices and/or appliances, such aswhether an appliance is on or off. For example, the monitoring servercan receive data from an indoor thermometer indicating that the indoortemperature is 75 degrees. The monitoring server can also receive datafrom a window blind controller indicating that the window blinds areopen, and from a coffee maker indicating that the coffee maker is off.The monitoring server can also receive data from a sound speaker,indicating a type of sound being broadcast at the property. Themonitoring server can also receive data from a scent-maker, e.g., an airfreshener, indicating a type of scent being produced at the property.

The process 300 includes, based on the sensor data and on thecharacteristic of the visitor, selecting and performing a monitoringsystem action (350). Selecting and performing the monitoring systemaction can include classifying, based on the characteristic of thevisitor, the visitor into a category of visitors. For example, based onthe characteristic that the visitor 222 is greater than six feet tall,the system can classify the visitor 222 into a category of “tall”visitors.

The system can identify property settings preferred by the category ofvisitors. Identifying the property settings preferred by the category ofvisitors can include accessing a database of property settings preferredby multiple categories of visitors. For example, the system may access adatabase stored by the monitoring server 250. The database can includeproperty settings preferred by multiple categories of visitors,including the “tall” category of visitors. The database may include, forexample, data indicating that visitors in the “tall” category generallyprefer warmer temperatures of greater than seventy degrees Fahrenheit.

The system can determine, based on the sensor data, that a propertysetting is different from the property settings preferred by thecategory of visitors. For example, the system may determine that thetemperature setting of the property 202 is at a cooler temperature ofless than seventy degrees Fahrenheit, and that the “tall” category ofvisitors prefer warmer temperatures of greater than seventy degreesFahrenheit. Thus, the system can determine that the temperature settingof the property 202 is different from the temperature setting preferredby the “tall” category of visitors.

The system can adjust the property setting to align the property settingwith the property settings preferred by the category of visitors. Forexample, the system can adjust the temperature setting of the property202 to align with the temperature setting preferred by the “tall”category, e.g., by raising the temperature setting of the property 202from less than seventy degrees Fahrenheit to greater than seventydegrees Fahrenheit.

Selecting and performing the monitoring system action can includedetermining, based on the characteristic of the visitor, a likelypreference of the visitor. Determining the likely preference of thevisitor can include providing the characteristic of the visitor as inputto a machine learning model that has been trained to determine likelypreferences corresponding to visitor characteristics. For example, thesystem can provide the characteristic that the visitor 222 is greaterthan six feet tall as input to a machine learning model, e.g., that isstored by the monitoring server 250.

The system can receive an output from the machine learning model thatindicates the likely preference of the visitor. The system candetermine, based on the received output from the machine learning model,the likely preference of the visitor. For example, the system canreceive output from the machine learning model that indicates a likelypreference of the visitor 222 for baking scents. The system candetermine, based on the received output from the machine learning model,that the visitor 222 likely prefers baking scents.

The system can determine that the sensor data indicates an attribute ofthe property that is different from the likely preference of thevisitor. For example, the system may determine that an air freshener atthe property 202 is releasing a woody scent, and thus the scentattribute of the property 202 is different from the likely preference ofthe visitor 222 for baking scents.

Based on determining that the sensor data indicates the attribute of theproperty that is different from the likely preference of the visitor,the system can adjust the attribute of the property to align theattribute of the property with the likely preference of the visitor. Forexample, based on determining that the scent attribute of the property202 is different from the likely preference of the visitor 222, thesystem can adjust the scent attribute of the property 202. The systemcan, for example, switch the air freshener at the property 202 fromreleasing the woody scent to releasing a baking scent.

The monitoring server can select and perform a monitoring system action,for example, based on pre-programmed rules or a machine learningalgorithm. System actions can include, for example, sending a command toa control unit to reconfigure an appliance or device at the property.For example, the monitoring server can send a command to the controlunit to lower a thermostat setting using automation controls. Themonitoring server can also send a command to the control unit to lowerthe window blinds, and to the coffee maker to turn on.

In some examples, the system can receive, from a second sensor at theproperty, second sensor data indicating a reaction of the visitor to theproperty. The system can store, in the database of property settings,the property setting and the data indicating the reaction of the visitorto the property. For example, the second sensor may be an indoor camera,e.g., camera 214 installed in the living room of property 202. Thesystem may receive, from the camera 214, image data indicating areaction of the visitor 222 donning a sweatshirt upon entering theproperty 202. The system can store, in the database of propertysettings, the temperature of the property 202 and the data indicatingthat the visitor 222 donned the sweatshirt upon entering the property202.

In some examples, the system can receive, through a user interfacepresented to the visitor by a computing device, user input dataindicating a reaction of the visitor to the property. The system canstore, in the database of property settings, the property setting andthe user input data indicating the reaction of the visitor to theproperty. For example, during or after the visit, the visitor 222 mayprovide feedback on the property 202, e.g., through a post-visit surveypresented to the visitor 222 through an application on a computingdevice associated with the visitor 222. The visitor 222 may input dataindicating that the property 202 was too cold. The system can store, inthe database of property settings, the temperature of the property andthe user input data indicating the visitor's reaction that the property202 was too cold.

In some examples, the system can determine, based on the image data, acharacteristic of a second visitor. The system can determine, based onthe characteristic of the second visitor, a likely preference of thesecond visitor that is different from the likely preference of the firstvisitor. For example, the visitor 222 may arrive with a second visitor.The second visitor can determine, based on the image data, acharacteristic of the second visitor that the second visitor has longhair. The system may determine, based on the characteristic of thesecond visitor that the second visitor has long hair, a likelypreference of the second visitor for cooler temperatures less thansixty-five degrees Fahrenheit. Thus, the system can determine that thelikely preference of the second visitor for cooler temperatures isdifferent from the likely preference of the first visitor for warmertemperatures.

Selecting and performing a monitoring system action can includeclassifying the first visitor as a lead visitor. For example, the systemmay classify the first visitor, e.g., visitor 222, as the lead visitorbased on the visitor 222 having scheduled the visiting appointment.

The system may determine that the sensor data indicates an attribute ofthe property that is different from the likely preference of the firstvisitor and is different from the likely preference of the secondvisitor. For example, the system may determine that a temperature of aproperty is sixty-seven degrees Fahrenheit, and is different from thelikely preference of the first visitor of greater than seventy degreesFahrenheit and from the likely preference of the second visitor of lessthan sixty-five degrees Fahrenheit

Based on determining that the sensor data indicates the attribute of theproperty that is different from the likely preference of the firstvisitor and is different from the likely preference of the secondvisitor, and in response to classifying the first visitor as the leadvisitor, the system can adjust the attribute of the property to alignthe attribute of the property with the likely preference of the firstvisitor. For example, based on determining that the temperature of theproperty 202 is different from the likely preference of the firstvisitor and from the likely preference of the second visitor, the systemcan adjust the temperature of the property 202 to align the temperatureof the temperature of the property 202 with the likely preference of thefirst visitor. For example, the system can adjust the temperature of theproperty 202 to a temperature greater than seventy degrees Fahrenheit toalign with the likely preference of the first visitor.

In some examples, the process can include, based on the sensor data andon a characteristic of the group of visitors, selecting and performingthe monitoring system action. Selecting and performing the monitoringsystem action can include classifying, based on the characteristic ofthe group of visitors, the group into a category of groups. For example,based on the characteristic of the group 125 that the group 125 is afamily of three that includes a school-age child, the system canclassify the group 125 into a category of “families with school-agechildren.”

The system can identify property settings preferred by the category ofgroups. For example, the system can identify property settings preferredby the group category of “families with school-age children.” Theproperty settings preferred by this category may include, for example,sounds of upbeat music.

The system can determine, based on the sensor data, that a propertysetting is different from the property settings preferred by thecategory of groups. For example, the system may determine, based on thesensor data, that the speaker 146 at the property 102 is playing mellowmusic. The system can determine that the speaker 146 playing mellowmusic is different from the property setting of upbeat music that ispreferred by the category of “families with school-age children.”

The system can adjust the property setting to align the property settingwith the property settings preferred by the category of groups. Forexample, the system can adjust the speaker 146 to play upbeat musicinstead of mellow music, to align the property sounds with the preferredsettings of the category of “families with school-age children.”

In some examples, the process can include receiving, from a secondmonitoring system of a second property, data representing an interactionof the visitor with the second property. For example, prior to visitingthe property 202, the visitor 222 may have visited a second property. Atthe second property, the visitor 222 may have turned on multiple lightsas the visitor 222 walked through the second property. The monitoringsystem of the property 202 may receive, from a second monitoring systemof the second property, data indicating that the visitor 222 turned onthe lights at the second property.

The process can include determining, based on the data representing theinteractions of the visitor with the second property, a likelypreference of the visitor. Based on the likely preference of thevisitor, the system can perform the monitoring system action. Forexample, based on the data indicating that the visitor 222 turned on thelights at the second property, the system may determine a likelypreference of the visitor 222 for bright lighting. Based on the likelypreference of the visitor 222 for bright lighting, the system canperform a monitoring system action of increasing a brightness of lightsat the property 202.

FIG. 4 is a diagram illustrating an example of a home monitoring system400. The monitoring system 400 includes a network 405, a control unit410, one or more user devices 440 and 450, a monitoring server 460, anda central alarm station server 470. In some examples, the network 405facilitates communications between the control unit 410, the one or moreuser devices 440 and 450, the monitoring server 460, and the centralalarm station server 470.

The network 405 is configured to enable exchange of electroniccommunications between devices connected to the network 405. Forexample, the network 405 may be configured to enable exchange ofelectronic communications between the control unit 410, the one or moreuser devices 440 and 450, the monitoring server 460, and the centralalarm station server 470. The network 405 may include, for example, oneor more of the Internet, Wide Area Networks (WANs), Local Area Networks(LANs), analog or digital wired and wireless telephone networks (e.g., apublic switched telephone network (PSTN), Integrated Services DigitalNetwork (ISDN), a cellular network, and Digital Subscriber Line (DSL)),radio, television, cable, satellite, or any other delivery or tunnelingmechanism for carrying data. Network 405 may include multiple networksor subnetworks, each of which may include, for example, a wired orwireless data pathway. The network 405 may include a circuit-switchednetwork, a packet-switched data network, or any other network able tocarry electronic communications (e.g., data or voice communications).For example, the network 405 may include networks based on the Internetprotocol (IP), asynchronous transfer mode (ATM), the PSTN,packet-switched networks based on IP, X.25, or Frame Relay, or othercomparable technologies and may support voice using, for example, VoIP,or other comparable protocols used for voice communications. The network405 may include one or more networks that include wireless data channelsand wireless voice channels. The network 405 may be a wireless network,a broadband network, or a combination of networks including a wirelessnetwork and a broadband network.

The control unit 410 includes a controller 412 and a network module 414.The controller 412 is configured to control a control unit monitoringsystem (e.g., a control unit system) that includes the control unit 410.In some examples, the controller 412 may include a processor or othercontrol circuitry configured to execute instructions of a program thatcontrols operation of a control unit system. In these examples, thecontroller 412 may be configured to receive input from sensors, flowmeters, or other devices included in the control unit system and controloperations of devices included in the household (e.g., speakers, lights,doors, etc.). For example, the controller 412 may be configured tocontrol operation of the network module 414 included in the control unit410.

The network module 414 is a communication device configured to exchangecommunications over the network 405. The network module 414 may be awireless communication module configured to exchange wirelesscommunications over the network 405. For example, the network module 414may be a wireless communication device configured to exchangecommunications over a wireless data channel and a wireless voicechannel. In this example, the network module 414 may transmit alarm dataover a wireless data channel and establish a two-way voice communicationsession over a wireless voice channel. The wireless communication devicemay include one or more of a LTE module, a GSM module, a radio modem,cellular transmission module, or any type of module configured toexchange communications in one of the following formats: LTE, GSM orGPRS, CDMA, EDGE or EGPRS, EV-DO or EVDO, UMTS, or IP.

The network module 414 also may be a wired communication moduleconfigured to exchange communications over the network 405 using a wiredconnection. For instance, the network module 414 may be a modem, anetwork interface card, or another type of network interface device. Thenetwork module 414 may be an Ethernet network card configured to enablethe control unit 410 to communicate over a local area network and/or theInternet. The network module 414 also may be a voice band modemconfigured to enable the alarm panel to communicate over the telephonelines of Plain Old Telephone Systems (POTS).

The control unit system that includes the control unit 410 includes oneor more sensors. For example, the monitoring system may include multiplesensors 420. The sensors 420 may include a lock sensor, a contactsensor, a motion sensor, or any other type of sensor included in acontrol unit system. The sensors 420 also may include an environmentalsensor, such as a temperature sensor, a water sensor, a rain sensor, awind sensor, a light sensor, a smoke detector, a carbon monoxidedetector, an air quality sensor, etc. The sensors 420 further mayinclude a health monitoring sensor, such as a prescription bottle sensorthat monitors taking of prescriptions, a blood pressure sensor, a bloodsugar sensor, a bed mat configured to sense presence of liquid (e.g.,bodily fluids) on the bed mat, etc. In some examples, thehealth-monitoring sensor can be a wearable sensor that attaches to auser in the home. The health-monitoring sensor can collect varioushealth data, including pulse, heart rate, respiration rate, sugar orglucose level, bodily temperature, or motion data.

The sensors 420 can also include a radio-frequency identification (RFID)sensor that identifies a particular article that includes a pre-assignedRFID tag.

The control unit 410 communicates with the home automation controls 422and a camera 430 to perform monitoring. The home automation controls 422are connected to one or more devices that enable automation of actionsin the home. For instance, the home automation controls 422 may beconnected to one or more lighting systems and may be configured tocontrol operation of the one or more lighting systems. In addition, thehome automation controls 422 may be connected to one or more electroniclocks at the home and may be configured to control operation of the oneor more electronic locks (e.g., control Z-Wave locks using wirelesscommunications in the Z-Wave protocol). Further, the home automationcontrols 422 may be connected to one or more appliances at the home andmay be configured to control operation of the one or more appliances.The home automation controls 422 may include multiple modules that areeach specific to the type of device being controlled in an automatedmanner. The home automation controls 422 may control the one or moredevices based on commands received from the control unit 410. Forinstance, the home automation controls 422 may cause a lighting systemto illuminate an area to provide a better image of the area whencaptured by a camera 430.

The camera 430 may be a video/photographic camera or other type ofoptical sensing device configured to capture images. For instance, thecamera 430 may be configured to capture images of an area within abuilding or home monitored by the control unit 410. The camera 430 maybe configured to capture single, static images of the area and alsovideo images of the area in which multiple images of the area arecaptured at a relatively high frequency (e.g., thirty images persecond). The camera 430 may be controlled based on commands receivedfrom the control unit 410.

The camera 430 may be triggered by several different types oftechniques. For instance, a Passive Infra-Red (PIR) motion sensor may bebuilt into the camera 430 and used to trigger the camera 430 to captureone or more images when motion is detected. The camera 430 also mayinclude a microwave motion sensor built into the camera and used totrigger the camera 430 to capture one or more images when motion isdetected. The camera 430 may have a “normally open” or “normally closed”digital input that can trigger capture of one or more images whenexternal sensors (e.g., the sensors 420, PIR, door/window, etc.) detectmotion or other events. In some implementations, the camera 430 receivesa command to capture an image when external devices detect motion oranother potential alarm event. The camera 430 may receive the commandfrom the controller 412 or directly from one of the sensors 420.

In some examples, the camera 430 triggers integrated or externalilluminators (e.g., Infra-Red, Z-wave controlled “white” lights, lightscontrolled by the home automation controls 422, etc.) to improve imagequality when the scene is dark. An integrated or separate light sensormay be used to determine if illumination is desired and may result inincreased image quality.

The camera 430 may be programmed with any combination of time/dayschedules, system “arming state”, or other variables to determinewhether images should be captured or not when triggers occur. The camera430 may enter a low-power mode when not capturing images. In this case,the camera 430 may wake periodically to check for inbound messages fromthe controller 412. The camera 430 may be powered by internal,replaceable batteries if located remotely from the control unit 410. Thecamera 430 may employ a small solar cell to recharge the battery whenlight is available. Alternatively, the camera 430 may be powered by thecontroller's 412 power supply if the camera 430 is co-located with thecontroller 412.

In some implementations, the camera 430 communicates directly with themonitoring server 460 over the Internet. In these implementations, imagedata captured by the camera 430 does not pass through the control unit410 and the camera 430 receives commands related to operation from themonitoring server 460.

The system 400 also includes thermostat 434 to perform dynamicenvironmental control at the home. The thermostat 434 is configured tomonitor temperature and/or energy consumption of an HVAC systemassociated with the thermostat 434, and is further configured to providecontrol of environmental (e.g., temperature) settings. In someimplementations, the thermostat 434 can additionally or alternativelyreceive data relating to activity at a home and/or environmental data ata home, e.g., at various locations indoors and outdoors at the home. Thethermostat 434 can directly measure energy consumption of the HVACsystem associated with the thermostat, or can estimate energyconsumption of the HVAC system associated with the thermostat 434, forexample, based on detected usage of one or more components of the HVACsystem associated with the thermostat 434. The thermostat 434 cancommunicate temperature and/or energy monitoring information to or fromthe control unit 410 and can control the environmental (e.g.,temperature) settings based on commands received from the control unit410.

In some implementations, the thermostat 434 is a dynamicallyprogrammable thermostat and can be integrated with the control unit 410.For example, the dynamically programmable thermostat 434 can include thecontrol unit 410, e.g., as an internal component to the dynamicallyprogrammable thermostat 434. In addition, the control unit 410 can be agateway device that communicates with the dynamically programmablethermostat 434. In some implementations, the thermostat 434 iscontrolled via one or more home automation controls 422.

A module 437 is connected to one or more components of an HVAC systemassociated with a home, and is configured to control operation of theone or more components of the HVAC system. In some implementations, themodule 437 is also configured to monitor energy consumption of the HVACsystem components, for example, by directly measuring the energyconsumption of the HVAC system components or by estimating the energyusage of the one or more HVAC system components based on detecting usageof components of the HVAC system. The module 437 can communicate energymonitoring information and the state of the HVAC system components tothe thermostat 434 and can control the one or more components of theHVAC system based on commands received from the thermostat 434.

In some examples, the system 400 further includes one or more roboticdevices 490. The robotic devices 490 may be any type of robots that arecapable of moving and taking actions that assist in home monitoring. Forexample, the robotic devices 490 may include drones that are capable ofmoving throughout a home based on automated control technology and/oruser input control provided by a user. In this example, the drones maybe able to fly, roll, walk, or otherwise move about the home. The dronesmay include helicopter type devices (e.g., quad copters), rollinghelicopter type devices (e.g., roller copter devices that can fly androll along the ground, walls, or ceiling) and land vehicle type devices(e.g., automated cars that drive around a home). In some cases, therobotic devices 490 may be devices that are intended for other purposesand merely associated with the system 400 for use in appropriatecircumstances. For instance, a robotic vacuum cleaner device may beassociated with the monitoring system 400 as one of the robotic devices490 and may be controlled to take action responsive to monitoring systemevents.

In some examples, the robotic devices 490 automatically navigate withina home. In these examples, the robotic devices 490 include sensors andcontrol processors that guide movement of the robotic devices 490 withinthe home. For instance, the robotic devices 490 may navigate within thehome using one or more cameras, one or more proximity sensors, one ormore gyroscopes, one or more accelerometers, one or more magnetometers,a global positioning system (GPS) unit, an altimeter, one or more sonaror laser sensors, and/or any other types of sensors that aid innavigation about a space. The robotic devices 490 may include controlprocessors that process output from the various sensors and control therobotic devices 490 to move along a path that reaches the desireddestination and avoids obstacles. In this regard, the control processorsdetect walls or other obstacles in the home and guide movement of therobotic devices 490 in a manner that avoids the walls and otherobstacles.

In addition, the robotic devices 490 may store data that describesattributes of the home. For instance, the robotic devices 490 may storea floorplan and/or a three-dimensional model of the home that enablesthe robotic devices 490 to navigate the home. During initialconfiguration, the robotic devices 490 may receive the data describingattributes of the home, determine a frame of reference to the data(e.g., a home or reference location in the home), and navigate the homebased on the frame of reference and the data describing attributes ofthe home. Further, initial configuration of the robotic devices 490 alsomay include learning of one or more navigation patterns in which a userprovides input to control the robotic devices 490 to perform a specificnavigation action (e.g., fly to an upstairs bedroom and spin aroundwhile capturing video and then return to a home charging base). In thisregard, the robotic devices 490 may learn and store the navigationpatterns such that the robotic devices 490 may automatically repeat thespecific navigation actions upon a later request.

In some examples, the robotic devices 490 may include data capture andrecording devices. In these examples, the robotic devices 490 mayinclude one or more cameras, one or more motion sensors, one or moremicrophones, one or more biometric data collection tools, one or moretemperature sensors, one or more humidity sensors, one or more air flowsensors, and/or any other types of sensors that may be useful incapturing monitoring data related to the home and users in the home. Theone or more biometric data collection tools may be configured to collectbiometric samples of a person in the home with or without contact of theperson. For instance, the biometric data collection tools may include afingerprint scanner, a hair sample collection tool, a skin cellcollection tool, and/or any other tool that allows the robotic devices490 to take and store a biometric sample that can be used to identifythe person (e.g., a biometric sample with DNA that can be used for DNAtesting).

In some implementations, the robotic devices 490 may include outputdevices. In these implementations, the robotic devices 490 may includeone or more displays, one or more speakers, and/or any type of outputdevices that allow the robotic devices 490 to communicate information toa nearby user.

The robotic devices 490 also may include a communication module thatenables the robotic devices 490 to communicate with the control unit410, each other, and/or other devices. The communication module may be awireless communication module that allows the robotic devices 490 tocommunicate wirelessly. For instance, the communication module may be aWi-Fi module that enables the robotic devices 490 to communicate over alocal wireless network at the home. The communication module further maybe a 900 MHz wireless communication module that enables the roboticdevices 490 to communicate directly with the control unit 410. Othertypes of short-range wireless communication protocols, such asBluetooth, Bluetooth LE, Z-wave, Zigbee, etc., may be used to allow therobotic devices 490 to communicate with other devices in the home. Insome implementations, the robotic devices 490 may communicate with eachother or with other devices of the system 400 through the network 405.

The robotic devices 490 further may include processor and storagecapabilities. The robotic devices 490 may include any suitableprocessing devices that enable the robotic devices 490 to operateapplications and perform the actions described throughout thisdisclosure. In addition, the robotic devices 490 may include solid-stateelectronic storage that enables the robotic devices 490 to storeapplications, configuration data, collected sensor data, and/or anyother type of information available to the robotic devices 490.

The robotic devices 490 are associated with one or more chargingstations. The charging stations may be located at predefined home baseor reference locations in the home. The robotic devices 490 may beconfigured to navigate to the charging stations after completion oftasks needed to be performed for the monitoring system 400. Forinstance, after completion of a monitoring operation or upon instructionby the control unit 410, the robotic devices 490 may be configured toautomatically fly to and land on one of the charging stations. In thisregard, the robotic devices 490 may automatically maintain a fullycharged battery in a state in which the robotic devices 490 are readyfor use by the monitoring system 400.

The charging stations may be contact based charging stations and/orwireless charging stations. For contact based charging stations, therobotic devices 490 may have readily accessible points of contact thatthe robotic devices 490 are capable of positioning and mating with acorresponding contact on the charging station. For instance, ahelicopter type robotic device may have an electronic contact on aportion of its landing gear that rests on and mates with an electronicpad of a charging station when the helicopter type robotic device landson the charging station. The electronic contact on the robotic devicemay include a cover that opens to expose the electronic contact when therobotic device is charging and closes to cover and insulate theelectronic contact when the robotic device is in operation.

For wireless charging stations, the robotic devices 490 may chargethrough a wireless exchange of power. In these cases, the roboticdevices 490 need only locate themselves closely enough to the wirelesscharging stations for the wireless exchange of power to occur. In thisregard, the positioning needed to land at a predefined home base orreference location in the home may be less precise than with a contactbased charging station. Based on the robotic devices 490 landing at awireless charging station, the wireless charging station outputs awireless signal that the robotic devices 490 receive and convert to apower signal that charges a battery maintained on the robotic devices490.

In some implementations, each of the robotic devices 490 has acorresponding and assigned charging station such that the number ofrobotic devices 490 equals the number of charging stations. In theseimplementations, the robotic devices 490 always navigate to the specificcharging station assigned to that robotic device. For instance, a firstrobotic device may always use a first charging station and a secondrobotic device may always use a second charging station.

In some examples, the robotic devices 490 may share charging stations.For instance, the robotic devices 490 may use one or more communitycharging stations that are capable of charging multiple robotic devices490. The community charging station may be configured to charge multiplerobotic devices 490 in parallel. The community charging station may beconfigured to charge multiple robotic devices 490 in serial such thatthe multiple robotic devices 490 take turns charging and, when fullycharged, return to a predefined home base or reference location in thehome that is not associated with a charger. The number of communitycharging stations may be less than the number of robotic devices 490.

In addition, the charging stations may not be assigned to specificrobotic devices 490 and may be capable of charging any of the roboticdevices 490. In this regard, the robotic devices 490 may use anysuitable, unoccupied charging station when not in use. For instance,when one of the robotic devices 490 has completed an operation or is inneed of battery charge, the control unit 410 references a stored tableof the occupancy status of each charging station and instructs therobotic device to navigate to the nearest charging station that isunoccupied.

The system 400 further includes one or more integrated security devices480. The one or more integrated security devices may include any type ofdevice used to provide alerts based on received sensor data. Forinstance, the one or more control units 410 may provide one or morealerts to the one or more integrated security input/output devices 480.Additionally, the one or more control units 410 may receive one or moresensor data from the sensors 420 and determine whether to provide analert to the one or more integrated security input/output devices 480.

The sensors 420, the home automation controls 422, the camera 430, thethermostat 434, and the integrated security devices 480 may communicatewith the controller 412 over communication links 424, 426, 428, 432,438, and 484. The communication links 424, 426, 428, 432, 438, and 484may be a wired or wireless data pathway configured to transmit signalsfrom the sensors 420, the home automation controls 422, the camera 430,the thermostat 434, and the integrated security devices 480 to thecontroller 412. The sensors 420, the home automation controls 422, thecamera 430, the thermostat 434, and the integrated security devices 480may continuously transmit sensed values to the controller 412,periodically transmit sensed values to the controller 412, or transmitsensed values to the controller 412 in response to a change in a sensedvalue.

The communication links 424, 426, 428, 432, 438, and 484 may include alocal network. The sensors 420, the home automation controls 422, thecamera 430, the thermostat 434, and the integrated security devices 480,and the controller 412 may exchange data and commands over the localnetwork. The local network may include 802.11 “Wi-Fi” wireless Ethernet(e.g., using low-power Wi-Fi chipsets), Z-Wave, Zigbee, Bluetooth,“Homeplug” or other “Powerline” networks that operate over AC wiring,and a Category 5 (CATS) or Category 6 (CAT6) wired Ethernet network. Thelocal network may be a mesh network constructed based on the devicesconnected to the mesh network.

The monitoring server 460 is an electronic device configured to providemonitoring services by exchanging electronic communications with thecontrol unit 410, the one or more user devices 440 and 450, and thecentral alarm station server 470 over the network 405. For example, themonitoring server 460 may be configured to monitor events generated bythe control unit 410. In this example, the monitoring server 460 mayexchange electronic communications with the network module 414 includedin the control unit 410 to receive information regarding events detectedby the control unit 410. The monitoring server 460 also may receiveinformation regarding events from the one or more user devices 440 and450.

In some examples, the monitoring server 460 may route alert datareceived from the network module 414 or the one or more user devices 440and 450 to the central alarm station server 470. For example, themonitoring server 460 may transmit the alert data to the central alarmstation server 470 over the network 405.

The monitoring server 460 may store sensor and image data received fromthe monitoring system and perform analysis of sensor and image datareceived from the monitoring system. Based on the analysis, themonitoring server 460 may communicate with and control aspects of thecontrol unit 410 or the one or more user devices 440 and 450.

The monitoring server 460 may provide various monitoring services to thesystem 400. For example, the monitoring server 460 may analyze thesensor, image, and other data to determine an activity pattern of aresident of the home monitored by the system 400. In someimplementations, the monitoring server 460 may analyze the data foralarm conditions or may determine and perform actions at the home byissuing commands to one or more of the controls 422, possibly throughthe control unit 410.

The monitoring server 460 can be configured to provide information(e.g., activity patterns) related to one or more residents of the homemonitored by the system 400. For example, one or more of the sensors420, the home automation controls 422, the camera 430, the thermostat434, and the integrated security devices 480 can collect data related toa resident including location information (e.g., if the resident is homeor is not home) and provide location information to the thermostat 434.

The central alarm station server 470 is an electronic device configuredto provide alarm monitoring service by exchanging communications withthe control unit 410, the one or more user devices 440 and 450, and themonitoring server 460 over the network 405. For example, the centralalarm station server 470 may be configured to monitor alerting eventsgenerated by the control unit 410. In this example, the central alarmstation server 470 may exchange communications with the network module414 included in the control unit 410 to receive information regardingalerting events detected by the control unit 410. The central alarmstation server 470 also may receive information regarding alertingevents from the one or more user devices 440 and 450 and/or themonitoring server 460.

The central alarm station server 470 is connected to multiple terminals472 and 474. The terminals 472 and 474 may be used by operators toprocess alerting events. For example, the central alarm station server470 may route alerting data to the terminals 472 and 474 to enable anoperator to process the alerting data. The terminals 472 and 474 mayinclude general-purpose computers (e.g., desktop personal computers,workstations, or laptop computers) that are configured to receivealerting data from a server in the central alarm station server 470 andrender a display of information based on the alerting data. Forinstance, the controller 412 may control the network module 414 totransmit, to the central alarm station server 470, alerting dataindicating that a sensor 420 detected motion from a motion sensor viathe sensors 420. The central alarm station server 470 may receive thealerting data and route the alerting data to the terminal 472 forprocessing by an operator associated with the terminal 472. The terminal472 may render a display to the operator that includes informationassociated with the alerting event (e.g., the lock sensor data, themotion sensor data, the contact sensor data, etc.) and the operator mayhandle the alerting event based on the displayed information.

In some implementations, the terminals 472 and 474 may be mobile devicesor devices designed for a specific function. Although FIG. 4 illustratestwo terminals for brevity, actual implementations may include more (and,perhaps, many more) terminals.

The one or more authorized user devices 440 and 450 are devices thathost and display user interfaces. For instance, the user device 440 is amobile device that hosts or runs one or more native applications (e.g.,the home monitoring application 442). The user device 440 may be acellular phone or a non-cellular locally networked device with adisplay. The user device 440 may include a cell phone, a smart phone, atablet PC, a personal digital assistant (“PDA”), or any other portabledevice configured to communicate over a network and display information.For example, implementations may also include Blackberry-type devices(e.g., as provided by Research in Motion), electronic organizers,iPhone-type devices (e.g., as provided by Apple), iPod devices (e.g., asprovided by Apple) or other portable music players, other communicationdevices, and handheld or portable electronic devices for gaming,communications, and/or data organization. The user device 440 mayperform functions unrelated to the monitoring system, such as placingpersonal telephone calls, playing music, playing video, displayingpictures, browsing the Internet, maintaining an electronic calendar,etc.

The user device 440 includes a home monitoring application 452. The homemonitoring application 442 refers to a software/firmware program runningon the corresponding mobile device that enables the user interface andfeatures described throughout. The user device 440 may load or installthe home monitoring application 442 based on data received over anetwork or data received from local media. The home monitoringapplication 442 runs on mobile devices platforms, such as iPhone, iPodtouch, Blackberry, Google Android, Windows Mobile, etc. The homemonitoring application 442 enables the user device 440 to receive andprocess image and sensor data from the monitoring system.

The user device 440 may be a general-purpose computer (e.g., a desktoppersonal computer, a workstation, or a laptop computer) that isconfigured to communicate with the monitoring server 460 and/or thecontrol unit 410 over the network 405. The user device 440 may beconfigured to display a smart home user interface 452 that is generatedby the user device 440 or generated by the monitoring server 460. Forexample, the user device 440 may be configured to display a userinterface (e.g., a web page) provided by the monitoring server 460 thatenables a user to perceive images captured by the camera 430 and/orreports related to the monitoring system. Although FIG. 4 illustratestwo user devices for brevity, actual implementations may include more(and, perhaps, many more) or fewer user devices.

In some implementations, the one or more user devices 440 and 450communicate with and receive monitoring system data from the controlunit 410 using the communication link 438. For instance, the one or moreuser devices 440 and 450 may communicate with the control unit 410 usingvarious local wireless protocols such as Wi-Fi, Bluetooth, Z-wave,Zigbee, HomePlug (ethernet over power line), or wired protocols such asEthernet and USB, to connect the one or more user devices 440 and 450 tolocal security and automation equipment. The one or more user devices440 and 450 may connect locally to the monitoring system and its sensorsand other devices. The local connection may improve the speed of statusand control communications because communicating through the network 405with a remote server (e.g., the monitoring server 460) may besignificantly slower.

Although the one or more user devices 440 and 450 are shown ascommunicating with the control unit 410, the one or more user devices440 and 450 may communicate directly with the sensors and other devicescontrolled by the control unit 410. In some implementations, the one ormore user devices 440 and 450 replace the control unit 410 and performthe functions of the control unit 410 for local monitoring and longrange/offsite communication.

In other implementations, the one or more user devices 440 and 450receive monitoring system data captured by the control unit 410 throughthe network 405. The one or more user devices 440, 450 may receive thedata from the control unit 410 through the network 405 or the monitoringserver 460 may relay data received from the control unit 410 to the oneor more user devices 440 and 450 through the network 405. In thisregard, the monitoring server 460 may facilitate communication betweenthe one or more user devices 440 and 450 and the monitoring system.

In some implementations, the one or more user devices 440 and 450 may beconfigured to switch whether the one or more user devices 440 and 450communicate with the control unit 410 directly (e.g., through link 438)or through the monitoring server 460 (e.g., through network 405) basedon a location of the one or more user devices 440 and 450. For instance,when the one or more user devices 440 and 450 are located close to thecontrol unit 410 and in range to communicate directly with the controlunit 410, the one or more user devices 440 and 450 use directcommunication. When the one or more user devices 440 and 450 are locatedfar from the control unit 410 and not in range to communicate directlywith the control unit 410, the one or more user devices 440 and 450 usecommunication through the monitoring server 460.

Although the one or more user devices 440 and 450 are shown as beingconnected to the network 405, in some implementations, the one or moreuser devices 440 and 450 are not connected to the network 405. In theseimplementations, the one or more user devices 440 and 450 communicatedirectly with one or more of the monitoring system components and nonetwork (e.g., Internet) connection or reliance on remote servers isneeded.

In some implementations, the one or more user devices 440 and 450 areused in conjunction with only local sensors and/or local devices in ahouse. In these implementations, the system 400 includes the one or moreuser devices 440 and 450, the sensors 420, the home automation controls422, the camera 430, and the robotic devices 490. The one or more userdevices 440 and 450 receive data directly from the sensors 420, the homeautomation controls 422, the camera 430, and the robotic devices 490,and sends data directly to the sensors 420, the home automation controls422, the camera 430, and the robotic devices 490. The one or more userdevices 440, 450 provide the appropriate interfaces/processing toprovide visual surveillance and reporting.

In other implementations, the system 400 further includes network 405and the sensors 420, the home automation controls 422, the camera 430,the thermostat 434, and the robotic devices 490, and are configured tocommunicate sensor and image data to the one or more user devices 440and 450 over network 405 (e.g., the Internet, cellular network, etc.).In yet another implementation, the sensors 420, the home automationcontrols 422, the camera 430, the thermostat 434, and the roboticdevices 490 (or a component, such as a bridge/router) are intelligentenough to change the communication pathway from a direct local pathwaywhen the one or more user devices 440 and 450 are in close physicalproximity to the sensors 420, the home automation controls 422, thecamera 430, the thermostat 434, and the robotic devices 490 to a pathwayover network 405 when the one or more user devices 440 and 450 arefarther from the sensors 420, the home automation controls 422, thecamera 430, the thermostat 434, and the robotic devices 490.

In some examples, the system leverages GPS information from the one ormore user devices 440 and 450 to determine whether the one or more userdevices 440 and 450 are close enough to the sensors 420, the homeautomation controls 422, the camera 430, the thermostat 434, and therobotic devices 490 to use the direct local pathway or whether the oneor more user devices 440 and 450 are far enough from the sensors 420,the home automation controls 422, the camera 430, the thermostat 434,and the robotic devices 490 that the pathway over network 405 isrequired.

In other examples, the system leverages status communications (e.g.,pinging) between the one or more user devices 440 and 450 and thesensors 420, the home automation controls 422, the camera 430, thethermostat 434, and the robotic devices 490 to determine whethercommunication using the direct local pathway is possible. Ifcommunication using the direct local pathway is possible, the one ormore user devices 440 and 450 communicate with the sensors 420, the homeautomation controls 422, the camera 430, the thermostat 434, and therobotic devices 490 using the direct local pathway. If communicationusing the direct local pathway is not possible, the one or more userdevices 440 and 450 communicate with the sensors 420, the homeautomation controls 422, the camera 430, the thermostat 434, and therobotic devices 490 using the pathway over network 405.

In some implementations, the system 400 provides end users with accessto images captured by the camera 430 to aid in decision making. Thesystem 400 may transmit the images captured by the camera 430 over awireless WAN network to the user devices 440 and 450. Becausetransmission over a wireless WAN network may be relatively expensive,the system 400 can use several techniques to reduce costs whileproviding access to significant levels of useful visual information(e.g., compressing data, down-sampling data, sending data only overinexpensive LAN connections, or other techniques).

In some implementations, a state of the monitoring system and otherevents sensed by the monitoring system may be used to enable/disablevideo/image recording devices (e.g., the camera 430). In theseimplementations, the camera 430 may be set to capture images on aperiodic basis when the alarm system is armed in an “away” state, butset not to capture images when the alarm system is armed in a “home”state or disarmed. In addition, the camera 430 may be triggered to begincapturing images when the alarm system detects an event, such as analarm event, a door-opening event for a door that leads to an areawithin a field of view of the camera 430, or motion in the area withinthe field of view of the camera 430. In other implementations, thecamera 430 may capture images continuously, but the captured images maybe stored or transmitted over a network when needed.

The described systems, methods, and techniques may be implemented indigital electronic circuitry, computer hardware, firmware, software, orin combinations of these elements. Apparatus implementing thesetechniques may include appropriate input and output devices, a computerprocessor, and a computer program product tangibly embodied in amachine-readable storage device for execution by a programmableprocessor. A process implementing these techniques may be performed by aprogrammable processor executing a program of instructions to performdesired functions by operating on input data and generating appropriateoutput. The techniques may be implemented in one or more computerprograms that are executable on a programmable system including at leastone programmable processor coupled to receive data and instructionsfrom, and to transmit data and instructions to, a data storage system,at least one input device, and at least one output device.

Each computer program may be implemented in a high-level procedural orobject-oriented programming language, or in assembly or machine languageif desired; and in any case, the language may be a compiled orinterpreted language. Suitable processors include, by way of example,both general and special purpose microprocessors. Generally, a processorwill receive instructions and data from a read-only memory and/or arandom access memory. Storage devices suitable for tangibly embodyingcomputer program instructions and data include all forms of non-volatilememory, including by way of example semiconductor memory devices, suchas Erasable Programmable Read-Only Memory (EPROM), Electrically ErasableProgrammable Read-Only Memory (EEPROM), and flash memory devices;magnetic disks such as internal hard disks and removable disks;magneto-optical disks; and Compact Disc Read-Only Memory (CD-ROM). Anyof the foregoing may be supplemented by, or incorporated in, speciallydesigned ASICs (application-specific integrated circuits).

It will be understood that various modifications may be made. Forexample, other useful implementations could be achieved if steps of thedisclosed techniques were performed in a different order and/or ifcomponents in the disclosed systems were combined in a different mannerand/or replaced or supplemented by other components. Accordingly, otherimplementations are within the scope of the disclosure.

What is claimed is:
 1. A monitoring system for monitoring a property,the monitoring system comprising one or more processors and one or morecomputer storage media storing instructions that are operable, whenexecuted by the one or more processors, to cause the one or moreprocessors to perform operations comprising: receiving data indicatingthat a visitor is scheduled to arrive at a property at a particulartime; receiving, at the particular time and from a camera, first imagedata; classifying, based on the first image data, the visitor into aparticular category of visitors; retrieving, from a database ofpreferences of multiple categories of visitors, a setting of a propertyattribute preferred by the particular category of visitors; adjusting atleast one device at the property to align the property attribute withthe setting preferred by the particular category of visitors; receiving,from a sensor at the property, second image data indicating a reactionof the visitor to the property; and storing, in the database ofpreferences of multiple categories of visitors, data representing (i)the setting of the property attribute and (ii) the reaction of thevisitor to the property.
 2. The monitoring system of claim 1, whereinthe visitor comprises a first visitor and the setting preferred by theparticular category of visitors comprises a first setting, theoperations comprising: classifying, based on the first image data, asecond visitor into a second particular category of visitors;retrieving, from the database of preferences of multiple categories ofvisitors, a second setting of the property attribute preferred by thesecond particular category of visitors, the second setting of theproperty attribute being different from the first setting; whereinadjusting the at least one device at the property to align the propertyattribute with the setting preferred by the particular category ofvisitors comprises: classifying the first visitor as a lead visitor; andbased on classifying the first visitor as the lead visitor, adjustingthe at least one device at the property to align the property attributewith the first setting preferred by the first visitor.
 3. The monitoringsystem of claim 1, the operations comprising: based on the dataindicating that the visitor is scheduled to arrive at the property atthe particular time, retrieving, at or before the particular time, andfrom a database of visitor profiles, a stored profile for the visitor.4. The monitoring system of claim 3, the operations comprising:determining, based on the first image data and the stored profile, thata person arriving at the property at or near the particular time is thevisitor that is scheduled to arrive at the property at the particulartime.
 5. The monitoring system of claim 3, wherein the stored profilefor the visitor includes data indicating at least one of: a setting of aproperty attribute preferred by the visitor; demographic information ofthe visitor; or a reaction of the visitor to a property previouslyvisited by the visitor.
 6. The monitoring system of claim 3, theoperations comprising: adding, to the stored profile for the visitor,the particular category of visitors into which the visitor isclassified.
 7. The monitoring system of claim 1, the operationscomprising: generating a profile of the visitor including the particularcategory of visitors into which the visitor is classified; and storingthe profile of the visitor in a database of visitor profiles.
 8. Themonitoring system of claim 1, the operations comprising: classifying,based on the first image data, a group of visitors into a particularcategory of visitor groups, wherein the group of visitors includes thevisitor and at least one other visitor; retrieving, from a database ofpreferences of multiple categories of visitor groups, a setting of asecond property attribute preferred by the particular category ofvisitor groups; and adjusting at least one device at the property toalign the second property attribute with the setting preferred by theparticular category of visitor groups.
 9. The monitoring system of claim1, the operations comprising: receiving, from a second monitoring systemof a second property, data representing an interaction of the visitorwith the second property; determining, based on the data representingthe interactions of the visitor with the second property, a setting of asecond property attribute preferred by the visitor; and based on thesetting of the second property attribute preferred by the visitor,adjusting at least one device at the property to align the secondproperty attribute with the setting preferred by the visitor.
 10. Themonitoring system of claim 1, wherein classifying the visitor into theparticular category of visitors comprises: determining, based on thefirst image data, a characteristic of the visitor, the characteristic ofthe visitor including one or more of an age, gender, apparel, accessory,or mode of transportation of the visitor; and classifying the visitorinto the particular category of visitors based on the characteristic ofthe visitor.
 11. The monitoring system of claim 1, wherein the propertyattribute includes one or more of a status of an appliance, a lightinglevel, a sound level, a temperature, or a scent at the property.
 12. Themonitoring system of claim 1, wherein: the setting of the propertyattribute preferred by the particular category of visitors comprises aparticular type of sound preferred by the particular category ofvisitors; and adjusting the at least one device at the property to alignthe property attribute with the setting preferred by the particularcategory of visitors comprises adjusting at least one audio speaker atthe property to broadcast the particular type of sound.
 13. Themonitoring system of claim 1, wherein: the setting of the propertyattribute preferred by the particular category of visitors comprises aparticular scent preferred by the particular category of visitors; andadjusting the at least one device at the property to align the propertyattribute with the setting preferred by the particular category ofvisitors comprises adjusting at least one scent-maker at the property torelease the particular scent.
 14. The monitoring system of claim 1,wherein: the setting of the property attribute preferred by theparticular category of visitors comprises a particular range oftemperatures preferred by the particular category of visitors; andadjusting the at least one device at the property to align the propertyattribute with the setting preferred by the particular category ofvisitors comprises adjusting at least one thermostat at the property tothe particular range of temperatures.
 15. The monitoring system of claim1, wherein: the setting of the property attribute preferred by theparticular category of visitors comprises a particular brightness oflighting preferred by the particular category of visitors; and adjustingthe at least one device at the property to align the property attributewith the setting preferred by the particular category of visitorscomprises adjusting at least one light at the property to the particularbrightness of lighting.
 16. A method, comprising: receiving, by aprocessor of a monitoring system, data indicating that a visitor isscheduled to arrive at a property at a particular time; receiving, atthe particular time and from a camera, first image data; classifying,based on the first image data, the visitor into a particular category ofvisitors; retrieving, from a database of preferences of multiplecategories of visitors, a setting of a property attribute preferred bythe particular category of visitors; adjusting at least one device atthe property to align the property attribute with the setting preferredby the particular category of visitors receiving, from a sensor at theproperty, second image data indicating a reaction of the visitor to theproperty; and storing, in the database of preferences of multiplecategories of visitors, data representing (i) the setting of theproperty attribute and (ii) the reaction of the visitor to the property.17. A non-transitory computer-readable medium storing softwarecomprising instructions executable by one or more computers of amonitoring system which, upon such execution, cause the one or morecomputers to perform operations comprising: receiving data indicatingthat a visitor is scheduled to arrive at a property at a particulartime; receiving, at the particular time and from a camera, first imagedata; classifying, based on the first image data, the visitor into aparticular category of visitors; retrieving, from a database ofpreferences of multiple categories of visitors, a setting of a propertyattribute preferred by the particular category of visitors; adjusting atleast one device at the property to align the property attribute withthe setting preferred by the particular category of visitors receiving,from a sensor at the property, second image data indicating a reactionof the visitor to the property; and storing, in the database ofpreferences of multiple categories of visitors, data representing (i)the setting of the property attribute and (ii) the reaction of thevisitor to the property.